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BACKGROUND OF THE INVENTION 

5 

1. Field of the Invention 

The present invention relates to the field of networking. More specifically, a 
first aspect of the present invention relates to packet diversion and insertion for high- 
speed network trafficking equipment, such as 10-gigabit optical-electrical routers or 
10 switches. A second aspect of the present invention relates to packet buffering and 
y flushing of the buffered packets. The present invention also relates to addressing 
ff both aspects in support of multiple datacom and telecom protocols. 

* 2. Background Information 

^ 15 With advances in integrated circuit, microprocessor, networking and 

communication technologies, increasing number of devices, in particular, digital 
O computing devices, are being networked together. Devices are often first coupled to 
if a local area network, such as an Ethernet based office/home network. In turn, the 
local area networks are interconnected together through wide area networks, such 
20 as SONET networks, ATM networks, Frame Relay, and the like. Of particular 
importance is the TCP/IP based global inter-network, the Internet. 

As a result of this trend of increased connectivity, increasing number of 
applications that are network dependent are being deployed. Examples of these 
network dependent applications include but are not limited to, the World Wide Web, 
25 e-mail, Internet based telephony, and various types of e-commerce and enterprise 
applications. The success of many content/service providers as well as commerce 
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sites depend on high-speed delivery of a large volume of data across wide areas. In 
turn, the trend leads to increased demand for high-speed data trafficking. 

Historically, data communication protocols specified the requirements of 
local/regional area networks, whereas telecommunication protocols specified the 
5 requirements of the regional/wide area networks. The rapid growth of high volume, 
high-speed data routing over the Internet has fueled a convergence of data 
communication (datacom) and telecommunication (telecom) protocols and 
requirements. It is increasingly important that data traffic be carried efficiently at 
high speed across local, regional and wide area networks. 
10 When routing or switching network traffic, a need often arises to divert some 

2 of the packets being routed/switched onto a routing path (to perform additional 
* processing or dropping the packets), or insert additional packets into the packet 
2j streams being received off a routing path. Figure 1 illustrates a typical prior art 
j0 approach to providing such functionality of packet diversion and/or packet insertion 
:s 15 to an "intermediate" networking equipment. Illustrated is an example networking 

M switch/router 50 having switching/routing fabric 52, including a number of 

W 

Q ingress/egress points 54a-54n, through which packets may be received and/or 
m! routed onto the corresponding coupled mediums (routing paths). To provide the 

desired packet diversion and/or insertion functionality, one or more of ingress/egress 
20 points 54a-54n, such as point 54n, are reserved for the coupling of one or more 
companion processors 56 (also referred to as host processors), as opposed to the 
mediums connecting the switch/router to a network. The basic implementations of 
these switches/routers would route all packets through host processors 56, to enable 
host processors 56 to selectively divert some of the packets from the various routing 
25 paths (for additional processing or dropping the packets) or to selectively inject 
additional packets into the packet streams of the various routing paths. In other 
more advanced implementations, additional switching/routing resources (such as 
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programmable switching/routing tables) (not shown) may be employed to facilitate 
routing of some of the packets of the routing paths to host processors 56 for 
"processing" ("diversion"), and routing of the packets injected by host processors 56 
onto the routing paths of their selection ("insertion"). 

5 These prior art approaches all suffer from the common disadvantage in that at 

least one of the ingress/egress point of switching/routing fabric 52 is used for the 
coupling of a host processor 56. As networking speed increases, with more and 
more packets being routed/switched over a unit of time, host processor 56 becomes 
a bottleneck under these prior art approaches. Typically, more than one host 

10 processor 56 have to be employed, resulting in more than one ingress/egress points 
54a-54n being consumed, which in turn leads to a reduction in the bandwidth of 
networking equipment 50 (for a given amount of switching/routing resources (fabric 
52)). Increasingly, these architectures are becoming un-scalable for the type of 
efficient, high speed (10Gb and beyond) networking that spans local, regional, and 

15 wide area networks, especially when multiple datacom and telecom protocols are 
involved. 

Thus, an improved approach to packet diversion and insertion, including 
buffering and flushing of buffered packets, is desired. 

20 

BRIEF DESCRIPTION OF DRAWINGS 

The present invention will be described by way of exemplary embodiments, 
but not limitations, illustrated in the accompanying drawings in which like references 
25 denote similar elements, and in which: 

Figure 1 illustrates a typical prior art approach to providing packet diversion 
and insertion; 

Primrose et al - Data Link/Physical 3 Express Mail Label No: 

Layer Packet Diversion and Insertion EL910784355US 



-Ml 

W4< 



SI 

m 



Attorney Docket Ref: 51040.P014 

Figure 2 illustrates an overview of the data link/physical layer packet 
diversion and insertion of present invention, in accordance with one embodiment; 

Figure 3 illustrates the buffering structure of Fig. 2 in further detail, in 
accordance with one embodiment; 
5 Figure 4 illustrates the egress divert block of Fig. 3 in further detail, including 

write packet drop logics equipped with tail flushing capability for multiple datacom 
and telecom protocols, in accordance with one embodiment; 

Figure 5 illustrates the egress insert block of Fig. 3 in further detail, including 
read packet drop logics equipped with head flushing capability for multiple datacom 
10 and telecom protocols, in accordance with one embodiment; 

Figure 6 illustrates the register interface of Fig. 3 in further detail, in 
accordance with one embodiment; 

Figure 7 illustrates the ingress divert block of Fig. 3 in further detail, including 
write packet drop logics equipped with tail flushing capability for multiple datacom 
15 and telecom protocols, in accordance with one embodiment; 

Figure 8 illustrates the ingress insert block of Fig. 3 in further detail, including 
read packet drop logics equipped with head flushing capability for multiple datacom 
and telecom protocols, in accordance with one embodiment; 

Figure 9 illustrates a multi-protocol network processor incorporated with the 
20 present invention, in accordance with one example application; and 

Figure 10 illustrates an optical networking module incorporated with the multi- 
protocol processor of Fig. 9, in accordance with another example application. 
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GLOSSARY 



10Gbase-LR 


64/66 coded 1310 nm LAN standard for 10 Gigabit 
Ethernet 


10Gbase-LW 


64/66 coded SONET encapsulated 1310 nm WAN 
standard for 1 0 Gigabit Ethernet 


ASIC 


Application Specific Integrated Circuit 


CRC 


Cyclic Redundancy Check 


Egress 


Outgoing data path from the system to the network 


EOP 


End of Packet 


EOS 


Ethernet on SONET 


FCS 


Frame Check Sequence 


FIFO 


First In First Out 


HDLC 


High-Level Data Link Control. A communication 
protocol used in Packet over SONET switching 
network. 


Ingress 


Incoming data path from the network to the system 


IP 


Internet Protocol 


LAN 


Local Area Network 


LVDS 


Low voltage differential signal 


MAC 


Media Access Control layer, defined for Ethernet 
systems 


OIF 


Optical Internetworking Forum 


POS 


Packet over SONET 
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ppp 

1 1 1 


Point to Point Protocol 


SDH 


Svnchronous Diaital Hierarchy 


SONET 


Synchronous Ontical network a PHY 
telecommunication protocol 


SOP 


Start of Packet 


SPI-4 


System Packet Interface Level 4(also POS-PHY 4) 


SSTL 


Stub Series Terminated Logic 


XGMII 


10Gb Media Independent Interface 


WAN 


Wide Area Network 



DETAILED DESCRIPTION OF THE INVENTION 

The present invention includes a buffering structure having storage structures 
and associated packet diversion and insertion logic to facilitate post-switching, pre- 
medium placement diversion and/or insertion of egress packets, and/or post-medium 
extraction, pre-switching diversion and/or insertion of ingress packets, in particular, 
during data link/physical layer processing of the ingress and/or egress packets. In 
another aspect, the buffering structure further includes selective tail and head 
flushing of the buffered packets. Both aspects address support for multiple datacom 
and telecom protocols. 

In the following description, various aspects of the present invention will be 
described. However, the present invention may be practiced with only some aspects 
of the present invention. For purposes of explanation, specific numbers, materials 
and configurations are set forth in order to provide a thorough understanding of the 
present invention. However, the present invention may be practiced without the 
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specific details. In other instances, well-known features are omitted or simplified in 
order not to obscure the present invention. Further, the description repeatedly uses 
the phrase "in one embodiment", which ordinarily does not refer to the same 
embodiment, although it may. The terms "comprising", "having", "including" and the 
5 like, as used in the present application, including in the claims, are synonymous. 

Overview 

Referring now to Figure 2, wherein a block diagram illustrating an overview of 
the present invention, in accordance with one embodiment, is shown. As illustrated, 
10 networking switch/router 60 having switching/routing fabric 62, including 
Cji ingress/egress points 64a-64n, through which packets may be received and/or 
y& routed onto the corresponding coupled mediums (routing paths), in accordance with 
C3 the present invention, is provided with a number of buffering structures 100a-100n to 

ICR 

l0 facilitate packet diversion and insertion, including selective tail or head flushing of 
15 buffered packets, for multiple datacom and telecom protocols. Buffering structures 

\l 100a-100n in accordance with the present invention are disposed between 

W 

q ingress/egress points 64a-64n and the corresponding mediums coupling 
5 switch/router 60 to one or more networks. As will be described in more detail below, 
each of buffering structures 100a-100n includes a number of storage structures, 
20 associated packet diversion and insertion logic, including packet flushing logic, as 
well as a processor interface to allow processors 66 to direct the diversion of 
packets, access the diverted packets, as well as inject packets for egress and/or 
ingress packets. Each of buffering structures 100a-100n also allows selective head 
or tail flushing of buffered packets. As a result of these features, and its 
25 advantageous disposition, buffering structures 100a-100 are able to facilitate post- 
switching, pre-medium placement, diversion and/or insertion of egress packets, as 
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well as post-medium extraction, pre-switching, diversion and/or insertion of ingress 
packets for multiple datacom and telecom protocols. 

As is readily apparent from the illustration, unlike the prior art, the present 
invention is able to facilitate the packet diversion and insertion functionalities without 
5 taking up ingress/egress points 64a-64n of switching/routing fabric 62, and 

therefore, bandwidth of switch/router 60. Moreover, the diversion and insertion of 
egress packets may be performed "very late", just prior to placement of the packets 
onto the coupling mediums, e.g. during data link/physical layer processing of the 
egress packets, and likewise, the diversion and insertion of ingress packets may be 
10 performed "very early", as soon as extraction of the packets from the coupling 
J mediums, e.g. during data link/physical layer processing of the ingress packets. 

Accordingly, in a presently preferred embodiment, as illustrated by an exemplary 
21 application of the present invention to be described later (referencing Fig. 9-10), 

"41 buffering structures 100a-100n are advantageously provided as an integral part of 
^ 15 the ASICs that provide data link/physical layer processing for multiple datacom and 
SI telecom protocols, in particular, in an integrated optical networking module. 



Buffering Structure 

Figure 3 illustrates one of buffering structures 100a-100n of Fig. 2 in further 
20 details in accordance with one embodiment As illustrated, for the embodiment, 

buffering structure 100i includes a number of egress packet storage structures 102a- 
102c, egress packet divert logic 104 and egress packet insert logic 106. Egress 
packet storage structures 102a-102c includes egress undiverted packet storage 
structure 102a, egress diverted packet storage structure 102b, and egress insert 
25 packet storage structure 102c, employed to stage the egress undiverted packets, 
egress diverted packets, and egress insert packets respectively. Egress packet 
divert logic 104 is employed to selectively divert some of the egress packets to the 
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diversion path, i.e. egress diverted packet storage structure 102b, whereas egress 
insert logic 106 is employed to selectively merge the staged egress insert packets 
onto the transmit path, i.e. merging the egress undiverted and insert packets staged 
at storage structures 102a and 102c. 
5 For the embodiment, buffering structure 100i further includes a number of 

ingress packet storage structures 122a-122c, ingress packet divert logic 124, 
ingress packet insert logic 126, and in particular, processor interface 112. Ingress 
packet storage structures 122a-122c includes ingress undiverted packet storage 
structure 122a, ingress diverted packet storage structure 122b, and ingress insert 
10 packet storage structure 122c, employed to stage the ingress undiverted packets, 
M ingress diverted packets, and ingress insert packets respectively. Ingress packet 
fj divert logic 124 is employed to selectively divert some of the ingress packets to the 
Sf diversion path, i.e. ingress divert storage structure 122b, whereas ingress packet 
* insert logic 126 is employed to selectively merge the staged ingress insert packets 
1 15 onto the receive path, i.e. merging the ingress undiverted and insert packets staged 
% 4 at storage structures 122a and 122c. 

a ; ii 

o In one embodiment, storage structures 102a-102c and 122a-122c are First-ln 

jte First-Outs (FIFO) storage structures; and processor interface 112 is a register-based 
interface, accessible via a data bus or processor interface (not shown), and includes 
20 associated read and write pointers. More specifically, in one embodiment, the 

egress undiverted packet FIFO 102a has a size of 1536 word by 73 bits (64-bits for 
the packet data, plus 4-bit SOP, 4-bit EOP and 1 bad packet bit indicator), and each 
of the egress diverted packet FIFO 102b and egress insert packet FIFO 102c has a 
size of 64 words by 73 bits. Similarly, the ingress undiverted packet FIFO 122a has 
25 a size of 1536 word by 73 bits, and each of the ingress diverted packet FIFO 122b 
and ingress insert packet FIFO 122c has a size of 64 words by 73 bits. 
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Before proceeding to describe the logic components, i.e. components 104- 
106 and 124-126, in further detail, it should be noted that while for completeness, 
the embodiment is comprehensively illustrated to include facilities associated with 
packet diversion and packet insertion for egress as well as ingress packets, in 
5 practice, the present invention may be practiced with only some of these features to 
practice only some of the aspects of the present invention, e.g. diversion of egress 
packets only, insertion of egress packets only, diversion of ingress packets only, or 
insertion of ingress packets only, or combination thereof. 

10 Egress Diversion 

Rj| Turning now to Figure 4, wherein egress packet divert logic 104 of Fig. 3 is 

* illustrated in further details in accordance with one embodiment. As shown, for the 
embodiment, egress packet divert logic 104 includes egress packet selector 132, 
egress undiverted packet gap compression logic 134, egress undiverted packet SS 
15 write and overflow packet drop logic 136, egress diverted packet gap compression 
logic 138, and egress diverted packet SS write, overflow and drop logic 136. 

Egress packet selector 132 is designed to receive the egress packet data, 
including the associated SOP, EOP, and bad packet bits, as well as a number of 
control signals. The control signals include in particular, a first control signal 
20 denoting an egress packet is to be diverted, and a second control signal denoting an 
egress packet is to be dropped. Responsive to the assertion of the divert control 
signal, egress packet selector 132 routes the egress packet data being received to 
the diversion path (diverted packet storage structure 102b); otherwise, the received 
egress packet data are allowed to pass thru onto the transmit path (undiverted 
25 packet storage structure 102a). 

Each of the egress packet gap compression logic 134 and 138 removes 
packet data gaps for the corresponding data paths, i.e. transmit and diversion paths. 
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Further, each of egress packet gap compression logic 134 and 138 generates a data 
ready signal for the corresponding following storage structure's write, overflow and 
drop logic 136 and 140, when a complete n-bit word of the egress packet is available 
(n being 64 in the earlier described FIFO embodiments). 
5 Each of the write, overflow and drop logic 136 and 140, in response, 

generates a write enable signal for the corresponding storage structure 102a and 
102b, and writes the n-bit word, along with the SOP, EOP and bad packet indicator 
bit into one n-bit storage word of the storage structure 102a/102b. Diverted packet 
write, overflow and drop logic 140 also generates a signal to convey packet 
10 availability to the host processor, when a complete packet is ready for the host 
£f processor to retrieve. 

# For the embodiment, each of write, overflow and drop logic 136 and 140 is 

also responsible for flushing the corresponding storage structure, i.e. storage 
structure 102a and 102b, total or tail only, when a corresponding flushing bit 
15 (specified e.g. in a configuration register (not shown)) is set. 

For the earlier described FIFO embodiments, total flushing of FIFO 
10 2a/ 102b may be accomplished by synchronously resetting both the associated 
write and read pointers (not shown) of the FIFO to zero. 

Further, for the embodiment, each of write, overflow and drop logic 136 and 
20 140 is responsible for packet dropping from the "tail" of the corresponding storage 
structure 102a and 102b ("tail flushing"). For the embodiment, each of write, 
overflow and drop logic 136 and 140 initiates the tail packet dropping/flushing 
process if one of a number of conditions occurs. Examples of these conditions 
include but are not limited to 
25 a) Storage structure overflow caused by an attempted write into a full storage 

structure; and 

b) In response to the earlier mentioned packet drop control signal. 

Primrose et al - Data Link/Physical 1 1 Express Mail Label No: 

Layer Packet Diversion and Insertion EL910784355US 



Attorney Docket Ref: 51040.P014 

For the earlier described FIFO embodiments, for the former cause (condition 
(a)), logic 136/140 reloads the associated write pointer to the SOP location of the 
packet being dropped + 2, and writing an EOP condition into the SOP+2 location, 
with the bad packet bit set. Further, the residual truncated packet is invalidated by 

5 the corresponding read, underflow and drop logic 142/144 of egress insert logic 106. 
This manner of tail flushing is performed except while operating for packets 
transmitted in accordance with the HDLC and SONET protocols. 

In one embodiment, in support of packets transmitted in accordance with the 
HDLC and SONET protocols, logic 136/140 also accounts for the possibility that the 

10 SOP has already been read out of storage structure 102a/102b, during an overflow 
situation. More specifically, for the earlier described FIFO embodiments, logic 
136/140 reloads the write pointer with the read pointer address plus 8. Logic 
136/140 then writes the EOP at this location, with the bad packet bit set, which 
results in a partial flush of the bad packet. The bad packet flag in turn will also alert 

15 a downstream MAC or HDLC processor that the preceding packet was aborted. In 
one embodiment, the MAC or HDLC processor responds by corrupting the CRC of 
the truncated packet to guarantee that the packet be dropped by a downstream 
entity. 

For the earlier described FIFO embodiments, for the latter cause (condition 
20 (b)), logic 136/140 also takes into account whether SOP of the aborted packet is still 
in the corresponding FIFO 102a/102b. If the SOP of the aborted packet is still in the 
FIFO, and if the SOP address is 6 greater than the read pointer address, upon 
detecting the packet drop signal, logic 136/140 reloads the FIFO write pointer with 
the abort packet's SOP address plus 2, and then writes the EOP to this location, with 
25 the bad packet bit set. Again, the residual partial packet is invalidated by the 

corresponding read, underflow and drop logic 142/144 of egress insert logic 106. If 
the SOP of the aborted packet is still in the FIFO, and if the SOP address is less 
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than 6 larger than the read pointer address, the EOP and bad packet bit is written to 
the read point address plus 8 to insure the read pointer will not advance past the 
write pointer and miss the EOP and bad packet bit, and cause the pointers to get out 
of sequence. The corresponding FIFO read, underflow and drop logic 142/144 of 
5 egress insert logic 106 is employed to invalidate the byte containing the EOP. If on 
the other hand, the SOP of the aborted packet has already been read out of the 
FIFO, logic 106 will reload the FIFO write pointer with the read pointer address plus 
8. Logic 106 then writes the EOP at this location, with the bad packet bit set, 
resulting in a partial flush of the bad packet. Again, the bad packet flag will be 
10 detected by the corresponding read, underflow and drop logic 142/144 of egress 
O insert logic 106. 

In one embodiment/in support of packets transmitted in accordance with the 
fl EOS protocol, write, overflow and drop logic 136/140 is also designed to generate 
■m the byte count of an EOS data packet (during an EOS mode of operation), to 
= 1 5 facilitate subsequent insertion of the packet byte length into a 2-byte field after the 
y preamble, during frame generation for EOS. In one embodiment, an additional 16- 
q bit wide, 40-word deep FIFO (not shown) is employed to store the generated EOS 
2 packet sizes. 

20 Egress Insertion 

Figure 5 illustrates egress packet insert logic 106 of Fig. 3 in further details in 
accordance with one embodiment. As illustrated, for the embodiment, egress packet 
insertion logic 106 includes egress undiverted packet SS read, underflow and drop 
logic 142, egress inserted packet SS read and path access logic 144, and egress 

25 packet merge logic 146. 
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Egress packet merge logic 146 is employed to generate a read enable signal 
for either read, underflow and drop logic 142 and 144 to select egress packets 
stored in one of the two storage structures 102a and 102c. 

Read, underflow and drop logic 142 is responsible for generating the read 
enable signal in response for the selection of storage structure 102a, to enable data 
flow from storage structure 102a. 

Read, underflow and drop logic 142 is also responsible for flushing the 
corresponding storage structure 102a, total or head only. For the earlier described 
FIFO embodiments, total flushing may be accomplished, as described earlier, by 
synchronously resetting both the write and read pointers to zero. No additional data 
words, of the current packet, will be written to the FIFO until a new SOP is received. 
Read, underflow and drop logic 142 will refrain from initiating any reading of the 
corresponding FIFO, until the FIFO word count of the corresponding FIFO exceeds a 
predetermined threshold. 

Read, underflow and drop logic 142 is also responsible for packet dropping 
from the "head" of the corresponding storage structure. In one embodiment, read, 
underflow and drop logic 142 performs the "head" packet drop/flush in response to a 
number of predetermined conditions. Examples of these conditions include but are 
not limited to 

a) Egress datapath underflow caused by an attempted read of an empty 
storage structure; and 

b) In response to a packet drop control signal. 

For the earlier described FIFO embodiments, for the earlier condition (i.e. 
condition (a)), read, underflow and drop logic 142 performs the "head" drop/flush by 
muxing an EOP into the data path. The action conveys to any subsequent (data 
link/physical layer) processing unit, e.g. a MAC or HDLC processor, that the current 
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packet is bad. In one embodiment, the MAC or HDLC processor responds by 

corrupting the CRC of the current packet. 

As described earlier, total flushing of the corresponding FIFO may be 

performed by synchronously resetting both the write and read pointers to zero. No 

5 additional data words, of the current packet, will be written into the corresponding 

FIFO, until a new SOP is received. Correspondingly, no reading of the FIFO on the 

output side will be initiated either, until the FIFO word count has reached a 

predetermined threshold. 

For the earlier described FIFO embodiments, for the latter condition (i.e. 

10 condition (b)), read, underflow and drop logic 142 determines if the SOP of the 

3[ aborted packet is still in the process of being read out in the output side, when the 

41 eop and bad packet bit are detected. If so, the remaining words of the truncated 

01 packet are invalidated. Thus, upon completing the dropping of the rest of the 

%§ aborted packet on the write side, dropping of the current packet is effectuated. 

s 1 5 If the SOP has already been read out, the EOP byte of the current word is 

S3 

S| invalidated. The action will notify subsequent processing units, such as MAC or 

r, 

O HDLC processors, that the current packet is bad. Again, in one embodiment, the 
JI MAC or HDLC processor responds by corrupting the CRC of the current packet. 

In like manner, read and path access logic 144 is responsible for generating 
20 the read enable signal in response for the selection of storage structure 102c, to 
enable data flow from storage structure 102c. Read and path access logic 144 is 
also responsible for notifying the host processor that it may provide additional insert 
data when storage structure 102c becomes empty. 

25 Processor Interface - Egress Packet Side 

Figure 6 illustrates processor interface 1 12 of Fig. 3 in further details in 
accordance with one embodiment. As illustrated, for the embodiment, for the egress 
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packet side, processor interface 112 includes a number of egress data read and 
write (R/W) registers, and their associated processor control slave logic 156, egress 
diverted packet unpacker and data formatter 152, and egress insert data packer and 
SOP/EOP generation logic 154. 
5 Egress data R/W registers, and their associated processor control slave logic 

156 are employed to facilitate a host processor in retrieving the egress diverted 
packet data, and providing the egress insert packet data. In response to a notice of 
the egress diverted packet data being ready for the host processor to retrieve, the 
host processor generates the appropriate control signals for egress diverted packet 
10 unpacker and data formatter 152 through the associated processor control slave 
logic 156. Egress diverted packet unpacker and data formatter 152 in response, 
ff generates the appropriate read enable signals for the egress diverted packet storage 
jj structure 102b. Further, unpacker and data formatter 152 reads the gap- 

compressed packet data and the associated SOP, EOP and bad packet indicator 
^ 15 from storage structure 102b, and "unpack" them for placement onto the appropriate 
H bit positions of the data bus. The process continues until the EOP is encountered 

if 1 1 

O (i.e. the applicable EOP bit set). 

M, In like manner, a host processor generates the appropriate control signals for 

egress insert data packer and SOP/EOP generation 154 through the associated 

20 processor control slave logic 156. Egress insert data packer and SOP/EOP 

generation 154 in response, generates the appropriate write enable signals for the 
egress insert storage structure 102c. Further, data packer and SOP/EOP 
generation 154 writes the insert data and the associated SOP, EOP and bad packet 
indicator bits into storage structure 102c in "packed" form, and the unpacked 

25 portions are successively taken off the appropriate bit positions of the data bus. 
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Ingress Diversion 

Figure 7 illustrates ingress packet divert logic 124 of Fig. 3 in further details 
in accordance with one embodiment. As illustrated, for the embodiment, ingress 
packet divert logic 124 includes ingress packet selector 162, ingress undiverted 
5 packet gap compression logic 164, ingress undiverted packet SS write, overflow and 
drop logic 166, ingress diverted packet gap compression logic 168, ingress diverted 
packet SS write, overflow and drop logic 170. 

Ingress packet selector 162 is designed to receive the packet data, including 
the associated SOP, EOP, and bad packet bits, as well as a number of control 
10 signals. The control signals include in particular, a first control signal denoting an 
0 ingress packet is to be diverted, and a second control signal denoting an ingress 
a packet is to be dropped. Responsive to the assertion of the control signal denoting 

03 an ingress packet is to be diverted, ingress packet selector 132 routes the ingress 

SI 

€i packet data being received to the diversion path (diverted packet storage structure 

« 15 122b); otherwise, the received ingress packet data are allowed to pass thru onto the 
Q receive path (undiverted packet storage structure 122a). 

wi 

p Each of the ingress packet gap compression logic 164 and 168 removes 

JT packet data gaps for the corresponding data paths, i.e. receive and diversion paths. 

Further, each of ingress packet gap compression logic 164 and 168 generates a 
20 data ready signal for the corresponding following storage structure's write, overflow 
and drop logic 166 and 170, when a complete n-bit word is available (n being 64 in 
the earlier described FIFO embodiments). 

Each of the write, overflow and drop logic 166 and 170, in response, 
generates a write enable signal for the corresponding storage structure 122a and 
25 122b, and writes the n-bit word, along with the SOP, EOP and bad packet indicator 
bit into one n-bit storage word. Diverted packet write, overflow and drop logic 170 
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also generates a signal to convey packet availability to a host processor, when a 
complete ingress packet is ready for the host processor to retrieve. 

For the embodiment, each of write, overflow and drop logic 166 and 170 is 
also responsible for flushing the corresponding storage structure, i.e. storage 
structure 122a and 122b (total or tail only), when a corresponding flushing bit 
(specified e.g. in a configuration register (not shown)) is set 

For the earlier described FIFO embodiments, total flushing FIFO 122a/122b 
may be accomplished by synchronously resetting both the associated write and read 
pointers of the FIFO to zero. 

Further, for the embodiment, each of write, overflow and drop logic 166 and 
170 is responsible for packet dropping from the "tail" of the corresponding storage 
structure 122a and 122b. For the embodiment, each of write, overflow and drop 
logic 166 and 170 initiates the packet dropping process if one of a number of 
conditions occurs. Examples of these conditions include but are not limited to 

a) Storage structure overflow caused by an attempted write into a full storage 
structure; and 

b) In response to the earlier mentioned packet drop control signal. 

For the earlier described FIFO embodiments, for the former cause (condition 
(a)), logic 166/170 reloads the associated write pointer to the SOP location of the 
packet being dropped + 2, and writing an EOP condition into the SOP+2 location, 
with the bad packet bit set. Further, the residual truncated packet is invalidated by 
the corresponding read, underflow and drop/path access logic 172/174 of ingress 
insert logic 126. This manner of tailing flushing is performed except when operating 
for packets transmitted in accordance with the HDLC and SONET protocols. 

In one embodiment, in support of packets transmitted in accordance with the 
HDLC and SONET protocols, logic 166/170 also accounts for the possibility that the 
SOP has already been read out of storage structure 122a/122b by the downstream 
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SPI-4 logic 204 (Fig. 9), during an overflow situation. More specifically, for the 
earlier described FIFO embodiments, logic 166/170 reloads the write pointer with the 
read pointer address plus 8. Logic 166/170 then writes the EOP at this location, with 
the bad packet bit set, which results in a partial flush of the bad packet. If the bad 
5 packet SOP has already been transferred to the downstream SPI-4 logic 204, an 
abort indication is asserted to the SPI-4 logic 204, causing the SPI-4 logic 204 to 
abort the bad packet transfer. 

For the earlier described FIFO embodiments, for the latter cause (condition 
(b), logic 166/170 also takes into account whether SOP of the aborted packet is still 
10 in the corresponding FIFO 122a/122b. If the SOP of the aborted packet is still in the 
O FIFO, and if the SOP address is 6 greater than the read pointer address, upon 
43 detecting the drop packet signal, logic 166/170 reloads the FIFO write pointer with 



the abort packet's SOP address plus 2, and then writes the EOP to this location, with 
the bad packet bit set. Again, the residual partial packet is invalidated by the 
15 corresponding read, underflow and drop/path access logic 172/174 of ingress insert 
logic 126. If the SOP of the aborted packet is still in the FIFO, and if the SOP 
address is less than 6 larger than the read pointer address, the EOP and bad packet 
bit is written to the read point address plus 8 to insure the read pointer will not 
advance pass the write pointer and miss the EOP and back packet bit, and cause 
20 the pointers to get out of sequence. The corresponding FIFO read, underflow and 
drop/path access logic 172/174 of ingress insert logic 126 is employed to invalidate 
the byte containing the EOP. If on the other hand, the SOP of the aborted packet 
has already been read out of the FIFO, logic 126 will reload the FIFO write pointer 
with the read pointer address plus 8. Logic 126 then writes the EOP at this location, 
25 with the bad packet bit set, resulting in a partial flush of the bad packet. Again, the 
bad packet flag will be detected by the corresponding read, underflow and drop/path 
access logic 172/174 of ingress insert logic 126. If the bad packet SOP has already 
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been read by the SPI-4 logic 204, logic 126 signals an abort condition to the SPI-4 
logic 204. This causes the SPI-4 logic 204 to abort the bad packet currently being 
transferred. 



5 Ingress Insertion 

Figure 8 illustrates ingress insertion logic 126 of Fig. 3 in further details in 
accordance with one embodiment. As illustrated, for the embodiment, ingress 
insertion logic 126 includes ingress undiverted packet read, underflow and drop logic 
172, ingress inserted packet read and path access logic 174, and ingress packet 
10 merge logic 176. 

Q Ingress packet merge logic 176 is employed to generate a read enable signal 

C for either read, underflow and drop logic 172 or read and access path logic 174 to 

SO select ingress packets stored in one of the two storage structures 122a and 122c. 

ft 

;|t Read, underflow and drop logic 172 is responsible for generating a read 

» 15 enable signal, in response, for the selection of storage structure 172a to enable data 

C1j flow from the selected storage structure 172a. 

g Read, underflow and drop logic 172 is also responsible for flushing the 

iu corresponding storage structure 122a (total or head only). For the earlier described 
FIFO embodiments, total flushing may be accomplished, as described earlier, by 
20 synchronously resetting both the write and read pointers to zero. No additional data 
words, of the current packet, will be written into the ingress packet FIFO until a new 
SOP is received. Read, underflow and drop logic 172 will refrain from initiating any 
reading of the corresponding FIFO, until the FIFO word count of the corresponding 
FIFO exceeds a predetermined threshold. 
25 Read, underflow and drop logic 172 is also responsible for packet dropping 

from the "head" of the corresponding storage structure 122a. In one embodiment, 
read, underflow and drop logic 172 performs the "head" packet drop in response to a 
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number of predetermined conditions. Examples of these conditions, include but are 
not limited to 

a) Ingress datapath underflow caused by an attempted read of an empty 
storage structure; 
5 b) In response to a packet drop control signal. 

For the earlier described FIFO embodiments, for the earlier condition 
(condition (a)), read, underflow and drop logic 172 performs the "head" drop by 
muxing an EOP into the data path. Additional, a control signal is generated for 
ingress packet merge 176 to forward the downstream processing units, e.g. a 
10 coupled system, that the current packet is to be dropped. 
Q As described earlier, total flushing of the corresponding FIFO may be 

€1 performed by synchronously resetting both the write and read pointers to zero. No 
OS additional data words, of the current packet, will be written into the corresponding 
m FIFO, until a new SOP is received. Corresponding, no reading of the FIFO on the 
s 15 output side will be initiated either, until the FIFO word count has reached a 
\1 predetermined threshold. 

O For the earlier described FIFO embodiments, for the latter condition (condition 

2 (b)), read, underflow and drop logic 142 determines if the SOP of the aborted packet 
is still in the process of being read out in the output side, when the EOP and bad 
20 packet bit are detected. If so, the remaining words of the truncated packet are 
invalidated. Thus, upon completing dropping the rest of the aborted packet on the 
write side, dropping of the current packet is effectuated. 

If the SOP has already been read out, a control signal is generated for 
ingress packet merge 176 to forward the downstream processing units, e.g. a 
25 coupled system, to denote for the downstream processing units that the current 
packet is to be dropped. 
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In like manner, read and path access logic 174 is responsible for generating 
the read enable signal in response for the selection of storage structure 122c, to 
enable data flow from storage structure 102c. Read and path access logic 174 is 
also responsible for notifying the host processor that it may provide additional 
5 ingress insert data when storage structure 122c becomes empty. 

Processor Interface - Ingress Side 
Referring back to Figure 6 again, wherein an embodiment of processor 
interface 112 of Fig. 3 is illustrated. As illustrated, for the embodiment, for the 
10 ingress packet side, processor interface 112 includes a number of ingress data read 
0 and write (R/W) registers, and their associated processor control slave logic 156, 
ypi ingress diverted packet unpacker and data formatter 1 58, and ingress insert data 
13 packer and SOP/EOP generation logic 1 60. 

CP 

II Ingress data R/W registers, and their associated processor control slave logic 

% 15 156 are employed to facilitate a host processor in retrieving the ingress diverted 
Si packet data and providing the ingress insert packet data. In response to a notice of 
2 the ingress diverted packet data being ready for a host processor to retrieve, the 
jj host processor generates the appropriate control signal for ingress diverted packet 
unpacker and data formatter 158 through the associated processor control slave 
20 logic 156. Ingress diverted packet unpacker and data formatter 158 in response, 
generates the appropriate read enable signals for the ingress diverted packet 
storage structure 122b. Further, unpacker and data formatter 172 reads the gap- 
compressed packet data and the associated SOP, EOP and bad packet indicator 
from storage structure 122b, and "unpack" them for placement onto the appropriate 
25 bit positions of the data bus. The process continues until the EOP is encountered 
(i.e. the applicable EOP bit set). 

Primrose et al - Data Link/Physical 22 Express Mail Label No: 

Layer Packet Diversion and Insertion EL910784355US 



Attorney Docket Ref : 51040.P014 

In like manner, a host processor generates the appropriate control signal for 
ingress insert data packer and SOP/EOP generation 160 through the associated 
processor control slave logic 156. Ingress insert data packer and SOP/EOP 
generation 160 in response, generates the appropriate write enable signals for the 
5 ingress insert storage structure 122c. Further, data packer and SOP/EOP 

generation 160 writes the insert data and the associated SOP, EOP and bad packet 
indicator bits into storage structure 122c in "packed" form, and the unpacked 
portions are successively taken off the appropriate bit positions of the data bus. 

10 Protocol Processor 

C5 Figure 9 illustrates an exemplary application of the present invention. 

H Illustrated in Fig. 9 is multi-protocol processor 200 incorporated with the packet 

m diversion and insertion teachings of the present invention, including packet flushing, 

CP 

H for multiple datacom and telecom protocols. As illustrated, for the embodiment, 
, 15 multi-protocol processor 200 includes system interface 204, network interface 206, 
intermediate interface 208, media access control block 21 0, Ethernet 64/64 coder 
g 212, Ethernet on SONET coder 214, point-to-point protocol (PPP) and high level 
f, data link control (HDLC) processor 216, HDLC Packet over SONET coder 218, 
SONET path processor 220, SONET section and line processor 222, and most 
20 importantly, buffering structure 100 of the present invention, coupled to each other 
as shown. Further, multi-protocol processor 200 includes control function unit and 
interfaces 307-309, Elements 204-222 are selectively employed in combination to 
service data transmission and receipt in accordance with a selected one of a number 
of frame based protocols, including frame based protocols encapsulated within a 
25 synchronous protocol, as well as streaming and packet variants of the synchronous 
protocol. In various embodiments, the protocols include at least one each a 
datacom and a telecom protocol, allowing multi-protocol processor 200 to support 
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data trafficking spanning local, regional as well as wide area networks. In a 
presently preferred embodiment, multi-protocol processor 200 is implemented as a 
single ASIC. 

More specifically, for the illustrated embodiment, the elements are employed 
in combination to service data transmission and receipt as follows: 



Protocols 


Elements Employed 


SONET Stream 


System Interface, SONET Section/Line 
Processor, Network Interface 


SONET Packet 


System Interface, SONET path processor, 
SONET Section/Line Processor, Network 
Interface 


Packet over 
SONET 


System Interface, HDLC processor, HDLC 
POS coder, SONET path processor, SONET 
Section/Line Processor, Network Interface 


Ethernet on 
SONET 


System Interface, 10GbE MAC, Ethernet on 
SONET coder, SONET path processor, 
SONET Section/Line Processor, Network 
Interface 


10GbE WAN 


System Interface, 10GbE MAC, Ethernet 64/66 
coder, SONET path processor, SONET 
Section/Line Processor, Network Interface 


10GbE LAN 


System Interface, 10GbE MAC, Ethernet 64/66 
coder, Network Interface 


MAC Frame 


System Interface, 10GbE MAC, Intermediate 
Interface 
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HDLC Frame 


System Interface, HDLC Processor, 




Intermediate Interface 



As those skilled in the art would appreciate, the concurrent support of these 
protocols in a dynamically selectable manner, in particular, the inclusion of 10Gb 
Ethernet and Packet over SONET protocols, advantageously enables the processor 
to scale local, regional, and wide area networks. 

For the illustrated embodiment, the "operating" protocol is specified to control 
function unit 308, which in turn controls the above enumerated elements 
accordingly. In a preferred variant of the illustrated embodiment, control function 
unit 308 includes a control register (not shown) having a 3-bit "protocol" field. The 3- 
bit "protocol" field is accessible via 3 corresponding pins (not shown) of processor 
interface 307. 

System interface 204 is provided to facilitate input of egress data and output 
of ingress data. In one embodiment, system interface 204 is a 16-bit parallel LVDS 
packet interface, compliant with OIF's SPI-4 interface defined for OIF-SPI4-02.0, 
which is a "phase 2" interface for the communication of packetized data between a 
physical layer and link layer entity. In one implementation, the 16-bit differential 
transmit and receive data busses operate at speed up to 832 Mb/s per bus line. By 
virtual of the ability of multi-protocol processor 200 to support the afore enumerated 
protocols, the transmit and receive data (i.e. the egress and ingress data) may be 
MAC, IP, PPP, HDLC or SONET framed/streaming data (including their in-band 
control words, where applicable). 

10GbE MAC block 210 is provided to perform data link sub-layer media 
access control processing on egress and ingress MAC and IP data. For egress 
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data, 10GbE MAC block 210 accepts correctly formatted frames (minus the 
preamble or start frame delimiter), and in response, adding the appropriate 
preamble/start frame delimiter, padding the frames to the maximum frame size, 
calculating and inserting the appropriate frame check sequences. 
5 Ethernet 64/66 coder 212 and Ethernet on SONET Coder 214 are provided to 

perform physical sub-layer 64/66 and Ethernet on SONET coding and decoding for 
the egress and ingress MAC and IP data respectively. 

PPP/HDLC processor 216 is provided to perform data link sub-layer point-to- 
point protocol and high level data link control processing on PPP and HDLC data. 
10 PPP/HDLC processor 216 is employed to frame or de-frame IP and POS data, 

0 providing appropriate encapsulation or de-encapsulation, in accordance to PPP and 
# HDLC. Similarly, HDLC POS coder 218 is provided to perform physical sub-layer 

Hj Packet on SONET coding and decoding for the egress and ingress HDLC data 

111 

respectively. 

1 15 SONET path processor 220 is provided to perform path processing for 
■u "packetized" SONET data, whereas SONET section and line processor 222 is 
S provided to perform section and line processing for "packetized" as well as 

P "streaming" SONET data. 

Network interface 206 is provided to facilitate output of egress data and input 

20 of ingress data. In one embodiment, correspondingly, Network interface 206 is a 16- 
bit LVDS interface compliant with OIF's SFI-4 interface. In one embodiment, it 
operates at 622 MHz (645 for Ethernet 64/66 encoded data). Similar to system 
interface 204, by virtue of the ability of processor 100 to support the various 
protocols, the egress and ingress data may be physically coded MAC, IP, PPP, 

25 HDLC or SONET framed/streaming data (including their in-band control words, 

where applicable). The coded data may be a SONET data stream encapsulating the 
higher-layer protocols or a 64/66 coded Ethernet stream. 
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Intermediate interface 208 on the other hand is provided to facilitate output of 
MAC or HDLC egress data and input of MAC or HDLC ingress data. In one 
embodiment, parallel interface 208 is a 32-bit SSTL-2 interface. In one embodiment, 
parallel interface 208 operates at 312.5 MHz. 

Multi-protocol processor 200 is the subject matter of co-pending application 
entitled "A Multi-Protocol Processor With Data Traffic Support Spanning Local, 
Regional and Wide Area Networks", having at least partial common inventorship and 
filed May 18, 2001. The co-pending application is hereby fully incorporated by 
reference. 

Optical Networking Module 
Figure 10 illustrates a further exemplary application of the present invention. 
Illustrated in Fig. 10 is integrated optical networking module 300 incorporated with 
multi-protocol processor 200 of Fig. 9, which as described earlier is incorporated 
with the packet diversion and insertion teachings of the present invention. Optical 
networking module 300 includes optical components 302, optical-electrical 
components 304, support control electronics 305, and multi-protocol processor 200 
of Fig. 9, coupled to each other as shown. As described earlier, multi-protocol 
processor 200 includes in particular, a number of interfaces and processing units, 
collectively referenced as reference number 310, control function unit 308, processor 
interface 307 and utility interface 309 coupled to each other and components 302- 
304 as shown. 

Optical components 302 are employed to facilitate the sending and receiving 
of optical signals encoded with data transmitted in accordance with a selected one of 
a plurality of protocols known in the art. Optical-electrical components 304 are 
employed to encode the egress data onto the optical signals, and decode the 
encoded ingress data. As described earlier, in a presently preferred embodiment, 
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the supported datacom and telecom protocols include but are not limited to 
SONET/SDH, 10Gbase-LR, 10Gbase-LW, Ethernet on SONET, Packet on SONET, 
and so forth. Support control electronics 305 are employed to facilitate management 
of the various aspects of optical components 302 and optical-electrical components 
5 304. As described earlier, multi-protocol processor 200 is employed to perform data 
link and physical sub-layer processing on the egress and ingress data in accordance 
with a selected one of a plurality of supported datacom/telecom protocols, and to 
facilitate management of the multi-protocol processor 200 itself and optical, optical- 
electrical components 302 and 304 (through support control electronics 305). 
10 In a presently preferred embodiment, optical components 302, optical- 

ly electrical components 304, support control electronics 305 and multi-protocol 
Ci processor ASIC 200 are encased in a body (not shown) forming a singular optical 

Co networking module, with provided software forming a singular control interface for all 

en 

m functionality. That is, in addition to being equipped to provide optical to electrical 
s 15 and electrical to optical conversions, clock and data recovery, and so forth, 
%} integrated optical networking module 300 is also equipped to provide data link and 
5 physical sub-layer processing on egress and ingress data selectively for a number of 
2 protocols. 

Further, in the preferred embodiment, control function unit 308 also includes 
20 control features, i.e. control registers and the like (not shown), in conjunction with 
support control electronics 305 to support a number of control functions for 
managing optical components 302, optical-electrical components 304 as well as 
multi-process protocol ASIC 200. Processor interface 307 is employed to facilitate 
provision of control specifications to control function unit 308, whereas utility 
25 interface 309 (a digital interface) is employed to facilitate management of 

components 302 and 304 by control function unit 308 (by way of support control 
electronics 305). The complementary control functions are placed with an 
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embedded processor of optical networking equipment employing integrated optical 
network module 300. That is, integrated optical networking module 300 
advantageously presents a singular unified software interface to optical networking 
equipment designers and developers to manage configuration and operation of the 
5 optical and electrical components, as well as protocol processing. As those skilled 
in the art would appreciate, as a result, the complexity of designing optical 
networking equipment, such as optical-eJectrical routers, switches, and the like, is 
reduced. 

Optical networking module 300 is the subject matter of co-pending application 
10 entitled "Optical Networking Module", having at least partial common inventorship 
and filed May 18, 2001. The co-pending application is hereby fully incorporated by 
reference. 



m Conclusion and Epilogue 

% 15 Thus, it can be seen from the above descriptions, a novel packet diversion 
%1 and insertion approach, including packet flushing, that is more scalable and suitable 
Pi for modern high speed networking, in particular, for efficient network trafficking that 
jr spans local, regional, and wide area networks in support of multiple datacom and 
telecom protocols has been described. While the present invention has been 
20 described in terms of the foregoing embodiments, those skilled in the art will 
recognize that the invention is not limited to these embodiments. The present 
invention may be practiced with modification and alteration within the spirit and 
scope of the appended claims. Thus, the description is to be regarded as illustrative 
instead of restrictive on the present invention. 
25 
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